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EXPLANATORY  COHERENCE  AND 
BELIEF  REVISION  IN  NAIVE  PHYSICS 


Michael  Ranney  and  PaulThagard 

Cognitive  Science  Laboratory 
Princeton  University 


Students  of  reasoning  have  long  tried  to  understand  how  people  revise  systems  of  beliefs 
(see  Wertheimer,  1945,  for  example).  We  will  describe  a  computational  model  of  how  experi¬ 
mental  subjects  revise  their  naive  beliefs  about  physical  motion.  We  maintain  that  people  often 
change  their  beliefs  in  ways  driven  by  considerations  of  explanatory  coherence.  After  describ¬ 
ing  instances  in  which  subjects  change  their  beliefs  while  learning  elementary  physics,  we  show 
how  their  belief  revisions  can  be  modeled  using  ECHO,  a  connectionist  computer  program  that 
uses  constraint-satisfaction  techniques  to  implement  a  theory  of  explanatory  coherence. 

THE  PHENOMENA:  CHANGES  IN  SYSTEMS  OF  BELIEFS 

Ranney  (1987a)  investigated  belief  change  in  naive  subjects  learning  elementary  physics 
by  using  feedback  provided  on  a  computer  display.  Subjects  were  asked  to  predict  the  motion  of 
several  projectiles  and  then  explain  these  predictions.  The  physical  contexts  were  quite  simple, 
involving  objects  that  were  either  thrown  or  released  in  various  ways.  Analyses  of  verbal  proto¬ 
col  data  indicate  that  subjects  sometimes  underwent  dramatic  belief  revisions  while  offering 
predictions  or  receiving  empirical  feedback.  We  will  describe  two  kinds  of  revisions. 

Pat’s  Changes 

Consider  "Pat,"  an  individual  who  was  asked  to  offer  predictions  about  events  including  (a) 
the  motion  of  a  heavy  object  dropped  by  a  briskly  walking  man  and  (b)  the  motion  of  a  heavy 
object  thrown  obliquely  upward.  Using  episodic  memories  and  mental  imagery,  Pat  initially 
predicted  that  the  object  dropped  by  the  man  would  fall  straight  down  (relative  to  the  ground). 
This  belief  is  a  common  finding  in  the  naive  physics  literature  (McCloskey,  Washburn,  &  Felch, 
1983).  Although  she  entertained  the  correct  prediction,  that  the  dropped  object  might  curve  for¬ 
ward  due  to  the  object’s  forward  "force"  (velocity),  she  preferred  to  stay  with  the  straight-down 
belief. 

Several  tasks  later,  when  faced  with  the  "upward-throw"  situation,  Pat  noted  a  similarity 
between  it  and  the  "walking-drop"  task  -  one  that  eventually  spawned  a  belief  revision.  While 
she  offered  the  correct  parabolic  trajectory  as  a  prediction  for  the  upward-throw,  she  noted  that, 
at  the  parabola’s  zenith,  the  upwardly  thrown  object  is  comparable  to  that  just  released  by  the 
walking  man.  That  is,  at  the  apex  of  the  thrown  object’s  trajectory,  it  has  an  exactly-horizontal 
motion,  as  does  the  just-dropped  object.  Pat  then  mentioned  that  this  observation  was  not  "con¬ 
sistent"  with  what  she  said  before  and,  if  she  were  to  be  consistent,  the  thrown  object  would 
"stop"  its  horizontal  motion  and  "then  just  fall  straight  down"  from  the  zenith  of  the  parabola. 
This  "curving-up-then-straight-down"  trajectory  was  not  consistent  with  her  past  experience  of 
falling  objects. 
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Pat  then  realized  that  her  memory-driven  description  of  the  ball  dropping  straight  down 
from  the  walking  man  involved  beliefs  that  were  incoherent  with  her  beliefs  about  the  parabolic 
motion  of  thrown  bodies.  After  a  period  of  ignoring  the  incoherence,  Pat  stated  that  she  had 
"constructed  a  consistent  theory  of  how  these  things  move."  Remarkably,  she  went  on  to  reject 
her  straight-down  prediction  for  the  walking-drop  task  and  accept  the  belief  that  the  path  would 
have  a  "slight  forward"  arc  combining  the  "forward  force"  and  gravity.  Eventually,  Pat  general¬ 
ized  this  notion,  discriminating  among  the  breadths  of  the  arcs  of  several  laterally  released  pro¬ 
jectiles.  . . 

Hal’s  Changes 

A  second  kind  of  systematic  belief  revision  occurred  in  subjects  who  offered  predictions, 
received  feedback,  and  provided  explanations  for  a  set  of  tasks  in  which  pendulum-bobs  were 
released  from  their  supportive  strings  during  various  points  in  a  swing.  This  set  of  tasks  was 
adapted  from  stimuli  used  by  Caramazza,  McCloskey,  &  Green,  (1981).  Because  of  the  similar¬ 
ity  among  several  of  the  subjects,  we  will  amalgamate  them  into  a  composite  subject  "Hal." 


Figure  1.  Hal’s  prediction  (*)  and  four  feedback  paths. 


Hal  predicted  that,  at  the  extreme  "endpoint"  of  a  swing,  a  released  bob  will  travel  laterally 
and  (eventually)  downward.  To  some  extent,  this  prediction  was  driven  by  images  of  children 
flying  off  playground  swings.  Via  feedback,  Hal  learned  that  a  bob  released  in  this  manner  actu¬ 
ally  falls  straight  down  (see  Figure  1,  position  E).  Most  of  the  subjects  observed  by  Ranney 
(1987a)  were  surprised  by  this  piece  of  feedback,  as  almost  90%  of  the  predicted  trajectories 
were  nonvertical.  Virtually  all  these  subjects  revised  some  beliefs,  offering  explanations  similar 
to  the  following  prototype: 


(Avail  .nc/or 
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Unlike  the  bobs  with  the  other  release-positions,  this  bob  went  directly  straight 
down,  not  to  the  side  at  all.  Since  it  had  no  lateral  motion  as  it  fell,  this  means 
that  the  object  had  no  speed  when  it  was  released.  Therefore,  the  pendulum  must 
have  been  temporarily  stopped,  when  the  bob  dropped.  This  makes  sense,  since 
the  pendulum  was  probably  slowing  down  -  and  it  had  to  stop  in  order  to  change 
directions! 

In  contrast  to  Pat’s  belief  change,  in  which  two  incoherent  predictions  caused  her  to  reject 
one  of  the  them,  Hal’s  belief  system  underwent  a  more  dramatic  revision.  He  came  to  accept 
both  the  straight-down  feedback  and  the  notion  of  an  instantaneous  zero  velocity,  while  rejecting 
both  his  earlier  (lateral)  prediction  and  an  impetus-driven  belief  regarding  pendular  motion. 
(See  Halloun  &  Hestenes,  1985,  and  Ranney,  1987b,  for  descriptions  of  different  sorts  of 
impetus  beliefs.) 


EXPLANATORY  COHERENCE  AS  A  MECHANISM 
FOR  SYSTEMATIC  BELIEF  REVISION 

How  can  we  account  for  these  systematic  changes  in  beliefs?  Both  cases  involved  a 
subject’s  attempt  to  adjust  beliefs  in  order  to  explain  a  surprising  observation.  An  adequate 
model  of  these  phenomena  must  provide  a  mechanism  by  which  a  coherent,  revised,  set  of 
beliefs  can  arise  from  the  need  for  explanation. 

ECHO 

Thagard  (1988a)  has  proposed  a  theory  of  explanatory  coherence  that  builds  on  previous 
ideas  about  the  evaluation  of  explanatory  hypotheses  (Hannan,  1986;  Thagard,  1988b).  The 
theory  has  been  implemented  in  a  connections  computer  program,  ECHO,  that  uses  parallel 
constraint  satisfaction  to  accept  and  reject  hypotheses  on  the  basis  of  their  explanatory  coher¬ 
ence.  ECHO  has  been  used  to  analyze  a  variety  of  scientific  arguments,  past  and  present: 
Lavoisier’s  case  for  his  oxygen  theory  against  the  phlogiston  theory,  Darwin’s  argument  for  evo¬ 
lution  by  natural  selection,  controversies  about  continental  drift  (Thagard  &  Nowak,  1988),  and 
debates  about  why  the  dinosaurs  became  extinct  Application  of  ECHO  to  the  belief  revisions  in 
Pat  and  Hal  is  novel  in  two  respects.  First,  we  are  modeling  subject  protocols  produced  during 
experiments  rather  than  finished  arguments.  Second,  these  models  are  dynamic,  in  that  ECHO 
changes  its  coherence  judgments  in  response  to  new  evidence. 

Space  constraints  permit  only  a  sketch  of  the  theory  of  explanatory  coherence  and  its 
implementation  (see  Thagard,  1988a,  for  greater  detail).  The  theory  is  stated  using  seven  princi¬ 
ples  of  explanatory  coherence  that  can  be  summarized  as  follows.  Principle  1,  Symmetry,  states 
that  coherence  and  incoherence  are  symmetric  relations.  Principle  2,  Explanation,  says  that 
hypotheses  that  together  explain  a  piece  of  evidence  cohere  with  the  evidence  and  with  each 
other,  and  that  the  degree  of  coherence  decreases  with  the  number  of  hypotheses  used  in  the 
explanation.  Principle  3,  Analogy,  attributes  coherence  to  similar  hypotheses  that  explain  simi¬ 
lar  pieces  of  evidence.  Principle  4,  Data  Priority,  states  that  pieces  of  evidence  have  a  degree  of 
coherence  in  themselves,  even  though  evidence  can  be  rejected  for  theoretical  reasons.  Accord¬ 
ing  to  principle  5,  Contradiction,  contradictory  propositions  are  incoherent.  Principles  6  and  7 
claim  that  the  explanatory  coherence  of  a  proposition  or  set  of  propositions  is  determined  by  the 
pairwise  relations  established  by  principles  1-5. 
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ECHO  is  a  Common  LISP  program  whose  input  consists  of  statements  about  the  explana¬ 
tory  and  contradictory  relations  among  propositions.  It  creates  units  representing  propositions 
and  sets  up  links  between  pairs  of  propositions  in  accord  with  the  above  principles  of  explana¬ 
tory  coherence.  If  two  propositions  cohere  because  they  are  both  arguments  of  a  particular 
explanation,  then  ECHO  sets  up  an  excitatory  link  between  them.  If  two  propositions  are 
incoherent  because  they  contradict  each  other,  then  ECHO  sets  up  an  inhibitory  link  between 
them.  In  accord  with  the  principle  of  data  priority,  propositions  representing  evidence  receive  a 
link  from  a  special  evidence  unit.  For  modeling  the  physics  students,  we  treat  as  evidence  pro¬ 
positions  based  cm  either  (a)  the  presence  or  absence  of  direct  observations,  (b)  memories  of 
such  observations,  or  (c)  facts  that  are  well-established  for  the  subject,  such  as  "gravity  pulls 
objects  downward." 

The  mathematics  underlying  ECHO  are  straightforward.  Following  typical  connectionist 
practice  (Rumelhart  &  McClelland,  1986),  each  unit  has  an  activation  that  is  updated  by  consid¬ 
ering  the  units  that  are  linked  to  it  A  unit’s  excitatory  link  with  another  unit  whose  activation  is 
greater  than  0  tends  to  increase  the  first  unit’s  activation,  while  an  inhibitory  link  with  the  other 
unit  tends  to  decrease  activation.  More  generally,  for  each  unit  j,  the  activation  a-  is  a  continu¬ 
ous  function  of  the  activation  of  all  the  units  linked  to  it,  with  each  unit’s  contribution  depending 
on  the  weight  Wy  of  the  link  from  unit  i  to  unit  j.  The  activation  of  a  unit  j  can  be  updated  from 
time  t  to  time  t+I  using  the  following  equation. 


(0(1-0) 


netj(max-aj(t)) 

netj(aj(t)-min) 


if  netj>  0 
otherwise 


0) 


Here  0  is  a  decay  parameter  that  decrements  each  unit  at  every  cycle,  min  is  minimum  activation 
(-1),  max  is  maximum  activation  (1),  and  netj  is  the  net  input  to  a  unit.  This  is  defined  by: 


netj  =  ^WijOiit) 


(2) 


Repeated  updating  cycles  result  in  some  beliefs  gaining  acceptance  (activation  >  0)  while  other 
are  rejected  (activation  <  0).  ECHO  networks  eventually  settle  into  stable  states  in  which  the 
units  have  asymptotic  activations  that  represent  their  coherence  with  other  units. 

Applying  ECHO  To  Pat’s  Belief  Revision 

We  have  used  ECHO  to  analyze  the  kinds  of  belief  revision  exhibited  in  the  subjects 
described  above.  In  each  case,  a  contradiction  among  the  subject’s  beliefs  appeared  to  serve  as 
the  motivation  for  the  observed  changes.  ECHO  deals  with  contradictions  gracefully,  treating 
them  as  a  pressures  to  change  beliefs,  but  otherwise  tolerating  them.  Pat’s  case  involved  a  criti¬ 
cal  incoherence  between  two  mutually  exclusive  predictions:  a  piece  of  evidence  that  was  sup¬ 
posedly  observed,  and  a  hypothesis  that  was  not  observed,  yet  consistent  with  other  observations 
and  hypotheses. 

The  following  is  a  list  of  Pat’s  initial  set  of  propositions,  as  garnered  from  her  verbal  proto¬ 
col  of  the  problem-solving  session.  They  represent  her  active  beliefs  just  after  she  provided  her 
straight-down  prediction  for  the  walking-drop  task. 
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Evidence: 

E 1 .  Cairied  objects  fall  straight-down  upon  release. 

E2.  Carried  objects  don’t  fall  diagonally  upon  release. 

Negative  Evidence  (proposed  observations  that  do  not  obtain ): 

NE1.  Carried  objects  fall  diagonally  upon  release. 

Common  Fact: 

CF1.  Gravity  moves  released  objects  downward. 

Newtonian  Hypotheses: 

NH1.  Laterally  moving  objects  curve  downward  (immediately)  upon  release. 

NH2.  Released  objects  move  forward  via  a  forward  velocity. 

Alternative  (non-Newtonian)  Hypotheses: 

AH1.  Horizontally  moving  objects  fall  straight-down  (immediately)  upon  release. 

AH2.  Released  objects  move  forward  via  a  forward  "force." 

The  following  are  Pat’s  original  verbalized  explanations,  manifested  in  ECHO  as  excitatory 
links  among  each  of  the  propositions  involved. 

Explanations: 

El  is  explained  by  AH1; 

E2  is  explained  by  NH1; 

E2  is  explained  by  AH1; 

NE1  is  explained  by  CF1  and  AH2; 

NH1  is  explained  by  CF1  and  NH2; 

The  next  set  of  relations  are  the  inconsistencies  that  Pat  originally  mentioned.  Recall  that 
the  contradiction  that  disturbed  Pat  was  the  one  between  El  and  NH1;  she  couldn’t  accept  both 
(a)  that  laterally-released  objects  curve  downward  and  (b)  that  carried  objects  (also  being 
laterally-released)  fall  straight-down. 

Contradictions: 

El  versus  NH1; 

E2  versus  NE1; 

NH1  versus  AH1; 

When  Pat  was  later  asked  to  offer  a  prediction  for  the  upward-throw  task,  she  added  the 
following  beliefs: 

New  Evidence: 

E3.  Upwardly  thrown  objects  curve  up-and-down. 

E4.  Upwardly  thrown  objects  do  not  curve  up  and  fall  straight-down. 

New  Negative  Evidence: 

NE2.  Upwardly  thrown  objects  curve  up,  then  fall  straight-down. 
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Finally,  Pat  verbalized  the  following  explanations  and  contradictions.  Note  that  the  expla¬ 
nation  of  NE2  is  essentially  a  (higher-order)  explanation  of  a  hypothesis  by  other  hypotheses: 

New  Explanations: 

H3  is  explained  by  NH1; 

E4  is  explained  by  NH1; 

NE2  is  explained  by  NH1  and  AH1; 

New  Contradictions: 

E3  versus  AH1; 

E4  versus  NE2; 

E4  versus  AHi; 


Figure  2.  Pat’s  explanatory  coherence  network. 

Figure  2  displays  the  network  ECHO  forms  from  the  above  explanations  and  contradic¬ 
tions,  with  solid  lines  representing  symmetrical  excitatory  links  and  dashed  lines  representing 
symmetrical  inhibitory  links.  We  suggest  that  the  figure  displays  the  essential  structural  aspects 
of  Pat’s  working  memory  during  the  belief  change  in  question.  The  graph  shows  that  prediction 
NH1  is  well-supported  by  evidence  E2,  E3,  and  E4,  as  well  as  by  fact  CF1  and  hypothesis  NH2. 
Prediction  El,  being  a  "remembered"  observation,  has  a  direct  source  of  activation  via  principle 
(4)  yet  is  supported  only  by  the  Aristotelian  hypothesis  AHI. 

In  order  to  approximate  Pat’s  belief  change,  ECHO  should  exhibit  both  an  initial  accep¬ 
tance  of  El,  followed  by  its  rejection  in  favor  of  NH1.  As  Figure  3  illustrates,  these  characteris¬ 
tics  are  indeed  captured  by  ECHO.  The  activation  (from  -1  to  +1  on  the  y-axis)  of  each  node  is 
plotted  against  time  (from  0  to  200  cycles  of  activation  updating).  With  each  node  initially  set 
to  zero  activation,  the  system  relaxes  into  more  and  more  coherent  states,  such  that  El’s  trajec¬ 
tory  follows  the  desired  nonmonotonic  path  --  rising  sharply,  then  falling  into  the  rejected  region 
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—  as  NH1  advances  and  AH1  declines.  The  other  propositions  are  similarly  accepted  or  rejected 
(or  held  in  limbo,  as  is  AH2),  depending  upon  their  local  coherence  relationships  within  the 
overall  constraint-satisfaction  system.  Note  that  the  model  also  simulates  the  temporal  aspect  of 
Pat’s  reasoning,  as  the  "new"  propositions,  E3,  E4,  and  NE2,  as  well  as  their  associated  explana¬ 
tions  and  contradictions,  are  introduced  after  a  brief  lag  (after  15  cycles).  The  final,  most  stable 
configuration  of  beliefs  happens  to  be  one  that  roughly  corresponds  to  Newtonian  motion.  (Of 
course,  if  Pat  happened  to  recall  other  evidence  that  supported  her  alternative  hypotheses,  this 
need  not  have  been  the  case.) 


All  AH2  CF1 


Figure  3.  The  activation  trajectories  of  Pat’s  beliefs. 


A  Dynamic  Simulation  Of  Hal’s  Belief  Revision 

A  simulation  of  Hal’s  belief  changes  involves  a  more  intensive  temporal  analysis.  Recall 
that  Hal’s  revision  was  due  to  an  empirically-driven  contradiction,  in  contrast  to  Pat’s  more 
memory-driven  contradiction.  Here  are  Hal’s  essential  original  beliefs  (i.e.,  his  beliefs  prior  to 
receiving  any  trajectory  feedback  about  pendulum-bobs  that  are  released  during  a  swing).  Keep 
in  mind  that  Hal  is  a  composite  subject:  these  are  beliefs  that  were  characteristic  of  many  of  the 
subjects  who  underwent  essentially  the  same  belief  revision. 

Evidence: 

El.  Kids  can  fly  off  the  end  of  a  playground  swing. 

E5.  A  pendulum  reverses  directions  at  the  endpoints. 

Common  Facts: 

CF1.  Gravity  pulls  objects  downward. 

CF2.  A  swing  is  a  pendulum. 

Classical  Physical  (Newtonian)  Hypotheses: 

CPI.  At  the  endpoints,  a  pendulum  is  at  rest. 

CP2.  A  laterally-released  object  moves  over  and  down. 

CP3.  The  slower  a  pendulum-bob’s  speed  at  release,  the  smaller  the  curved  trajectory. 
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Alternative  (non  Newtonian)  Hypotheses: 

AH1.  At  the  er  ’points,  a  pendulum-bob  continues  its  preceding  lateral  motion. 

Predictions: 

PI.  At  the  endpoint,  a  released  bob  will  move  over  and  down. 

P2.  At  the  endpoint,  a  released  bob  will  fall  straight-down. 

Both  El  and  E5  are  remembered  observations.  E2,  E3,  and  E4  were  intentionally  left  out 
for  now,  since  these  pieces  of  evidence  will  be  sequentially  added  as  feedback,  as  described 
later.  The  following  explanations  and  contradictions  were  common  to  protocols  reflecting  Hal’s 
belief  revision.  Note  that  here  the  critical  incoherence  (which  feedback  eventually  resolves)  is 
between  PI  and  P2,  two  mutually-exclusive  predictions  with  different  levels  of  support  and 
competition. 

Explanations: 

El  is  explained  by  AH1  and  CF2; 

E 5  is  explained  by  CPI; 

PI  is  explained  by  AH1  and  CP2; 

P2  is  explained  by  CPI  and  CP3; 

P2  is  explained  by  CPI  and  CF1; 

CP2  is  explained  by  CF1; 

Contradictions: 

El  versus  P2;  PI  versus  P2;  CPI  versus  AH1; 

Figure  4  shows  that,  when  ECHO  is  loaded  in  such  a  fashion  at  time  tQ,  the  system  reaches 
a  stable  state  by  t.  (after  150  processing  cycles).  Among  other  dynamic  relationships,  these 
graphs  show  that  PI  (the  curving-down-at-endpoint  prediction)  is  believed,  while  its  antagonist, 
P2  (the  straight-down-at-endpoint  prediction),  is  disbelieved  --  as  indicated  by  its  negative 
activation.  Thus,  tj  represents  the  state  of  Hal’s  belief  system  prior  to  any  feedback. 

At  ty  t^,  and  t^  (of  Figure  4),  evidence  about  other  pendular-release  positions  is  acquired 
in  the  form  of  direct  observations  (i.e.,  feedback)  E2,  E3,  and  E4.  These  "within-swing"  paths 
are  readily  explained  by  (and  hence  support)  propositions  CF1,  CP2,  and  CP3: 

New  Evidence: 

E2.  A  bob  released  on  a  downswing  curves  down  after  its  release. 

E3.  A  bob  released  from  midswing  curves  out  (a  lot)  after  its  release. 

E4.  A  bob  released  on  an  upswing  curves  up-and-down  after  its  release. 

New  Explanations: 

E2  is  explained  by  CF1,  CP2,  and  CP3; 

E3  is  explained  by  CF1,  CP2,  and  CP3; 

E4  is  explained  by  CF1,  CP2,  and  CP3; 

The  system  then  settles  into  state  t,  (after  400  total  cycles).  Figure  4  shows  that,  except  for 
the  generalization  expressed  in  CP3  (relating  release-velocity  to  the  breadth  of  curves),  little  has 
changed  from  state  tj;  PI  is  still  believed  and  P2  is  not.  Figure  5  shows  Hal’s  belief  system 
from  t^  onward,  including  all  excitatory  and  inhibitory  links. 
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As  described  earlier,  it  is  at  time  t,  that  the  dramatic  belief  revision  begins,  driven  by  the 
surprising  feedback  that,  contrary  to  PI,  the  endpoint  release  yields  a  straight-down  path  (as 
predicted  by  the  disbelieved  P2).  This  feedback  is  simulated  in  ECHO  by  making  P2  a  data 
node,  thus  providing  it  with  a  direct  source  of  activation  (like  E1-E5,  CF1,  and  CF2  which  also 
have  data  priority.)  As  Figure  4  indicates,  this  single  change  has  five  dramatic  consequences 
between  tg  and  Hal’s  ultimate  state  (after  850  total  cycles),  ty.  (a)  P2  gains  acceptance,  flipping 
from  a  negative  to  a  positive  activation-state,  while  (b)  the  antagonistic  PI  is  rejected,  (c)  CPI, 
the  notion  of  instantaneous  zero  velocity,  achieves  acceptance,  while  (d)  its  non-Newtonian 
antagonist,  AH1,  is  rejected,  (e)  Even  El,  a  fallacious  piece  of  "evidence"  (i.e.,  that  kids  can  fly 
off  the  end  of  swings)  loses  support  These  changes  essentially  reflect  the  belief  revisions  ver¬ 
balized  by  subjects  like  Hal. 


ASSESSING  THE  MODEL 

While  these  simulations  provide  general  correspondence  with  Pat’s  and  Hal’s  changes  in 
belief,  there  are  several  methodological  questions  to  consider.  We  must  ask  how  sensitive 
ECHO  is  to  (a)  the  particular  representation  of  an  individual’s  beliefs  and  (b)  the  particular 
parameters  involved  in  activation-passing. 

How  arbitrary  are  the  representations  that  are  put  to  ECHO?  Although  Pat’s  beliefs  were 
garnered  directly  from  audio-taped  protocols,  there  is  no  fool-proof  algorithm  for  translating 
utterances  into  propositions,  so  analysis  has  some  latitude.  Similarly,  although  we  tried  to 
include  only  relations  that  were  explicitly  used  in  Pat’s  explanations,  this  part  of  the  analysis 
also  involves  some  subjectivity.  It  is  particularly  difficult  for  the  coder  to  refrain  from  adding  an 
obvious  node  or  a  link  even  though  the  particular  subject  didn’t  vocalize  that  obvious  belief  or 
relationship.  (For  instance,  the  authors  found  it  difficult  to  not  add  an  inhibitory  link  between 
Pat’s  AH2  and  NH2.)  Constructing  Hal’s  belief  system  allowed  for  more  latitude  than  Pat’s, 
since  he  is  a  composite.  Still,  care  was  taken  to  create  the  network  first  —  before  tinkering  with 
die  processing  parameters  -  so  that  we  would  be  less  likely  to  "kludge"  the  representation. 

There  is  also  another  kind  of  representational  question:  What  does  one  of  these  networks 
actually  represent?  Generally,  we  conceive  of  the  networks  as  models  of  the  current  contents  of 
working  memory.  Note,  however,  that  by  "current"  we  also  mean  "contextual,"  because  sub¬ 
jects  can  hold  a  belief  in  one  context  that  they  disbelieve  in  another.  For  instance,  in  an  abstract 
context,  most  subjects  explicitly  held  CPI,  that  there  is  no  speed  at  a  pendulum’s  endpoints  — 
even  those,  like  Hal,  who  would  reject  it  (in  favor  of  AH1)  during  the  context  of  the  pendular- 
release  tasks. 

A  general  problem  with  connectionist  cognitive  models  is  that  they  usually  have  numerous 
numerical  parameters  that  can  be  manipulated  to  produce  desired  results.  Does  our  simulation 
depend  on  fine  parameter  tuning?  The  most  important  parameters  in  ECHO  include  the  weight 
value  of  excitatory  links,  the  negative  weight  value  of  inhibitory  links,  the  weight  value  of  the 
(data  priority)  links  between  evidence  and  the  special  evidence  unit,  and  the  decay  of  each  unit 
at  each  cycle.  The  simulations  of  both  Pat  and  Hal  used  the  same  parameter  settings,  and 
yielded  the  desired  trajectories  over  similar  ranges  for  each  parameter.  These  common  parame¬ 
ter  ranges  were:  .015  to  .05  for  excitatory  weights,  -.05  to  -.065  for  inhibitory  weights,  .035  to 
.075  for  data-priority  weights,  and  .01  to  .065  for  the  decay  rate. 

The  simulations  might  have  employed  even  more  parameters.  For  instance,  we  treated  units 
representing  direct  observations,  memories,  and  facts  all  as  evidence,  with  each  linked  to  the 
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special  evidence  unit  by  the  same  weight.  But  one  can  argue  for  varying  these  weights  for  dif¬ 
ferent  kinds  of  evidence,  increasing  them  for  current  observations  and  decreasing  them  for  fuzzy 
memories.  Not  all  evidence  has  the  same  epistemic  status.  In  particular,  when  Hal  is  directly 
presented  with  a  phenomenon  on  the  computer  screen  in  front  of  him,  this  becomes  a  very 
salient  piece  of  evidence.  Accordingly,  one  might  argue  that  the  unit  representing  the  surprising 
observation  that  the  pendulum  bob  falls  straight  down  at  the  end  of  its  swing  should  be  a  multi¬ 
ple  of  the  data  priority  of  remembered  evidence. 

FUTURE  RESEARCH 

We  have  been  modeling  previously  performed  experiments,  but  ECHO  can  also  be  used  to 
make  predictions  about  the  beliefs  of  subjects.  Our  simulation  of  Hal  predicted  that  he  would 
come  to  doubt  the  belief  that  kids  can  fly  off  the  end  of  a  playground  swing,  but  very  few  sub¬ 
jects  explicitly  re-evaluated  this  belief.  ECHO  predicts  that  the  subjects  may  have  experienced 
this  belief  change  even  if  they  did  not  mention  it,  and  this  prediction  can  be  tested  in  new  experi¬ 
ments  by  asking  subjects  to  stare  their  confidence  in  belief  El  following  the  relevant  feedback. 
Additional  experimental  tests  of  the  extent  to  which  ECHO  models  human  performance  can  be 
done  in  situations  where  people  face  difficult  inference  problems  involving  judgments  of  expla¬ 
natory  coherence.  We  conjecture  that  problems  that  are  relatively  hard  for  people,  as  measured 
perhaps  by  the  length  of  time  to  generate  answers,  will  also  be  relatively  hard  for  ECHO,  as 
measured  by  the  number  of  cycles  it  takes  the  system  to  reach  a  stable  state.  Legal  reasoning,  in 
which  jurors  attempt  to  construct  a  coherent  account  of  the  evidence  (Pennington  &  Hastie, 
1987),  appears  to  be  a  particularly  promising  domain  for  future  empirical  tests  of  the  ECHO 
model. 
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Madison,  WX  53706 

GOLDMAN  SUSAN 
Dr.  Susan  R.  Goldman 
Dept .  of  Education 
University  of  California 
Santa  Barbara,  CA  93106 

GOTT  SHERRIE 
Dr.  Sherrie  Gott 
AFHRL/MOMJ 

Brooks  AFB,  TX  78235-5601 

GOVXNDARAJ  T 
Dr.  T.  Govindaraj 
Georgia  Institute  of 
Technology 
School  of  Industrial 

and  System  Engineering 
Atlanta,  GA  30332-0205 

GRAX  WAYNE 
Dr.  Wayne  Gray 
Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

GREEN  BERT 
Dr.  Bert  Green 
Johns  Hopkins  University 
Department  of  Psychology 
Charles  £  34th  Street 
Baltimore,  MD  21218 

GREENO  JAMES  G 
Dr.  James  G.  Greeno 
School  of  Education 
Stanford  University 
Room  311 

Stanford,  CA  94305 
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.  HAKRTEL  EDWARD 
trot.  Edward  Haertel 
School  of  Education 
Stanford  University 
Stanford,  CA  94305 

HAMBLETON  RONALD  K 
Or.  Ronald  K.  Ranblaton 
Onivoraity  of  Maaaaehuaotta 
laboratory  of  Psychometric 
and  Evaluative  Roaoarch 
Billa  South,  Roon  152 
Amherst,  MA  01003 

HAMMAPKL  RAX 
Or.  Ray  Hannapel 
Scientific  and  Engineering 
geraonnel  and  Education 
Rational  Science  goundation 
Washington,  DC  20550 

HARVEY  WAYNE 

Dr.  Wayne  Harvey 

Center  for  Learning  Technology 

Education  Development  Center 

55  Chapel  Street 

Newton,  HA  02160 

HATES  JOHN  R 
Dr.  John  R.  Hayea 
Caraegie-Mellon  Onivoraity 
Department  of  Psychology 
Schenley  Park 
Pittsburgh,  PA  15213 

HOLLAND  MELISSA 
Dr.  Melissa  Holland 
Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

HOLXOAK  KEITH 
Dr.  Keith  Holyoak 
Department  of  Psychology 
Onivoraity  of  California 
Los  Angeles,  CA  90024 

HOTCHINS  ED 
Dr.  Ed  Hutchins 
Intelligent  Systems  Croup 
Institute  for 

Cognitive  Science  (C-015) 

OCSD 

La  Jolla,  CA  92093 

JACKSON  JANET 
Dr.  Janet  Jackson 
Ri jksuniversiteit  Groningen 
Biologisch  Centrum,  vieugel  D 
Kerklaan  30,  9751  NN  Haren 
The  NETHERLANDS 

JANNARONE  ROBERT 
Or.  Robert  Jannarone 
Elec,  and  Computer  Eng.  Dept. 
Oniversity  of  South  Carolina 
Columbia,  SC  29208 


JANVIER  CLAUDE 
Dr.  Claude  Janvier 
Universite'  du  Quebec  a  Montreal 
P.O.  Box  8888,  aucc:  A" 

Montreal,  Quebec  H3C  3P8 
CANADA 


JEPTRIES  ROBIN 

Dr.  Robin  Jeffries 

Hewlett-Packard  Laboratories,  3L 

P.O.  Box  10490 

Palo  Alto,  CA  94303-0971 

JONES  DOUGLAS  B 
Dr.  Douglas  H.  Jones 
Thatcher  Jones  Associates 
P.O.  Box  6640 
10  Trafalgar  Court 
Lawreneeville,  NJ  08648 

JUST  MARCEL 
Dr.  Marcel  Just 
Carnegie-Mellon  University 
Department  of  Psychology 
Schenley  Park 
Pittsburgh,  PA  15213 

KATZ  MILTON  S 
Dr.  Milton  S.  Kats 
European  Science  Coordination 
Office 

U.3.  Army  Research  Institute 
Box  65 

PPO  New  Xork  09510-1500 

KELLOGG  WENDY 

Dr.  Wendy  Kellogg 

IBM  T.  J.  Watson  Research  Ctr. 

P.O.  Box  704 

Xorktown  Heights,  NX  10598 

KIBLER  DENNIS 
Dr .  Dennis  Kibler 
University  of  California 
Department  of  Information 
and  Computer  Science 
Irvine,  CA  92717 

KIERAS  DAVID 

Or.  David  Kieras 

Technical  Communication  Program 

TIDAL  Bldg.,  2360  Bonisteel  Blvd. 

University  of  Michigan 

Ann  Arbor,  MI  48109-2108 

KINCAID  J  PETER 
Or.  J.  Peter  Kincaid 
Army  Research  Institute 
Orlando  Field  Unit 
c/o  PM  TRADE-E 
Orlando,  FL  32813 
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KXlffSCH  WALTER 
.  Dr.  Walter  Hints eh 
Department  of  Psychology 
University  of  Colorado 
Bool dor,  CO  80309-0345 

KLAHR  DAVID 
Dr.  David  Xlahr 
Carnegie -Mel Ion  University 
Department  of  Psychology 
Sebenley  Park 
Pittsburgh,  PA  1S213 

KOTOVSKY  KENNETH 
Dr.  Kenneth  Kotovsky 
Corn i  ty  College  of 
Allegheny  County 
SOP  Kidge  Avenue 
Pittsburgh,  PA  13212 

KRANTZ  DAVID  H 
Dr.  David  H.  Krantz 
Department  of  Psychology 
Columbia  University 
406  Schermerhoro  Hall 
Mew  York,  NT  10027 

KYLLONEN  PATRICK 
Dr.  Patrick  Kyllonen 
Institute  for  Behavioral 

Research 

Graduate  Studies  Bldg. 
University  of  Georgia 
Athens,  GA  30602 

LANGLEY  PAT 
Dr.  Pat  Langley 
University  of  California 
Department  of  Information 
and  Computer  Science 
Irvine,  CA  92717 

LARKIN  JILL 
Dr.  Jill  Larkin 
Caraegie-Mellon  University 
Department  of  Psychology 
Pittsburgh,  PA  13213 

LAVE  JEAN 
Or .  Jean  Lave 
Institute  for  Research 
on  Learning 
3333  Coyote  Hill  Road 
Palo  Alto,  CA  92304 

LAWLER  ROBERT 

Dr.  Robert  W.  Lawler 

Matthews  118 

Purdue  University 

West  Lafayette,  IN  47907 

LESGOLD  ALAN 
Dr.  Alan  M.  Lesgold 
Learning  RCO  Center 
University  of  Pittsburgh 
Pittsburgh,  PA  15260 


.  LEVIN  JAMES 
Dr .  Jia  Levin 
Department  of 

Educational  Psychology 
210  Education  Building 
1310  South  Sixth  Street 
Champaign,  IL  61820-6990 

LEVINS  JOHN 
Dr.  John  Levine 
Learning  R6D  Center 
University  of  Pittsburgh 
Pittsburgh,  PA  15260 

LEVINS  MICHAEL 
Dr.  Michael  Levine 
Educational  Psychology 
210  Education  Bldg. 

University  of  Illinois 
Champaign,  IL  61801 

LEWIS  CLAYTON 
Dr.  Clayton  Lewis 
university  of  Colorado 
Department  of  Computor  Scionce 
Campus  Box  430 
Boulder,  CO  80309 

LEWIS  MATT 
Matt  Lewis 

Department  of  Psychology 
Camogio-Mollon  University 
Pittsburgh,  PA  15213 

LIBRARY  NTSC 
Library 

Naval  Training  Systeau  Contar 
Orlando,  IX  32813 

LIBRARY  NWC 
Library 

Naval  War  Collage 
Newport,  RI  02940 

LIBRARY  OP  CONGRESS 
Scionco  end  Technology  Division 
Library  of  Congrass 
Washington,  DC  20540 

LINN  MARCIA  C 
Dr.  Marcia  C.  Linn 
Graduate  School 

of  Education,  EMST 
Tolman  Kail 

University  of  California 
Borkoloy,  CA  94720 

LINN  ROBERT  L 
Dr.  Robert  L.  Linn 
Campus  Box  249 
University  of  Colorado 
Boulder,  CO  80309-0249 

MALOY  WILLIAM  L 
Dr.  William  L.  Maloy 
Naval  Education  and  Training 
. Program  Support  Activity 
Code  047 
Building  2435 
Penaecola,  FL  32509-5000 
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MARSHALL  SANDRA  P 

Dr.  Sandra  P.  Marshall 

Dept.  of  Psychology 

San  Diego  State  University 

San  Diego,  CA  92182 

MAYER  RICHARD 
Dr.  Richard  s.  Mayer 
Department  of  Psychology 
Dni varsity  of  California 
Santa  Barbara,  CA  93108 

MCBRXDR  JAMES  R 

Dr.  James  R.  McBride 

The  Psychological  Corporation 

1250  Sixth  Avenue 

San  Diego,  CA  92101 

MCDONALD  BARBARA 
Dr.  Barbara  McDonald 
Navy  Personnel  R4D  Center 
San  Diego,  CA  92152-8800 

MCLACHLAH  JOSEPH  C 
Dr.  Joseph  C.  McLaehlan 
Code  32 

Navy  Personnel  RED  Center 
San  Oiego,  CA  92152-8800 

MCMXCHAEL  JAMES 
Dr.  Janes  McMichael 
Technical  Director 
Navy  Personnel  RSD  Center 
San  Diego,  CA  92152-8800 

MEANS  BARBARA 
Dr.  Barbara  Means 
SRZ  International 
333  Ravens  wood  Avenue 
Menlo  Park,  CA  94025 

MESTRE  JOSE 
Dr.  Jose  Mestre 
Department  of  Physics 
Hasbrouck  Laboratory 
University  of  Massachusetts 
Amherst,  MA  01003 

MILLER  GEORGE  A 
Dr.  George  A.  Miller 
Dept,  of  Psychology 
Green  Hall 

Princeton  University 
Princeton,  NJ  08540 

MISLEVY  ROBERT 
Dr.  Robert  Misievy 
Educational  Testing  Service 
Princeton,  NJ  08541 

MOLNAR  ANDREW  R 
.  Dr.  Andrew  R.  Molnar 
Applic.  of  Advanced  Technology 
Science  and  Engr.  Education 
National  Science  Foundation 
Washington,  DC  20550 


MONTAGUE  WILLIAM 
Dr.  William  Montague 
NFRDC  Code  13 
San  Diego,  CA  92152-8800 

MONRO  ALLEN 
Dr.  Allen  Munro 
Behavioral  Technology 
Laboratories  -  USC 
1845  S.  Elena  Ave.,  4th  Floor 
Redondo  Beach,  CA  90277 

NX3BETT  RICHARD  E 
Dr.  Richard  E.  Nisbett 
University  of  Michigan 
Institute  for  Social  Research 
Room  5261 

Ann  Arbor,  MI  48109 

NORMAN  DONALD  A 

Dr.  Donald  A.  Norman 

C-015 

Institute  for  Cognitive  Science 
University  of  California 
La  Jolla,  CA  92093 

NPRDC  01A 

Deputy  Technical  Director 
NPRDC  Code  01A  . 

San  Diego,  CA  92152-6800 

NPRDC  05 

Director,  Training  Laboratory, 
NPRDC  (Code  05) 

San  Diego,  CA  92152-8800 

NPRDC  06 

Director,  Manpower  and  Personnel 
Laboratory, 

NPRDC  (Code  06) 

San  Diego,  CA  92152-6800 

NPRDC  07 

Director,  Human  Factors 

(  Organisational  Systems  Lab, 
NPRDC  (Code  07) 

San  Diego,  CA  92152-6800 

NPRDC  LIBRARY 
Library,  NPRDC 
Code  P201L 

San  Diego,  CA  92152-6800 

NPRDC  TECHNICAL  DIRECTOR 
Technical  Director 
Navy  Personnel  RSD  Center 
San  Diego,  CA  92152-6800 

NRL  CODE  2627 
Commanding  Officer, 

Naval  Research  Laboratory 
Code  2627 

Nashington,  DC  20390 
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O'NEIL  HAARY  P 

Dr.  Harold  P.  O' Mail,  Jr. 

School  of  education  •  USH  801 
Deoartment  of  educational 
B*Psyehology  8  Technology 
University  of  Southern  California 
Loa  Angela* ,  CA  90089-0031 

OHLSSON  STBLLAN 
Or.  Stellan  Ohlseon 
Learning  H  &  0  Center 
University  of  Pittsburgh 
Pittsburgh,  PA  13260 
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PEARCE  DOUGLAS 
Or.  Douglas  Pearce 
1133  Sheppard  M 
Boa  2000 

Downaview,  Ontario 
CANADA  M3M  3B9 

PENTAGON  TRAINING  8  PERSONNEL  TECHNOLOGY 
Military  Assistant  for  Training  and  I 

Personnel  Technology, 

OOSD  (R  8  E) 

Room  30129,  The  Pentagon 
Washington,  DC  20301-3080 


OMR  CODE  1142 
Office  of  Naval  Research, 
Code  1142 
800  N.  Quincy  St. 
Arlington,  VA  22217-5000 


PERES  RAY  S 
Or.  Ray  S.  Perea 
ARI  (PERZ-XI)  4 

3001  Eisenhower  Avenue 
Alexandria,  VA  22333 


OMR  CODE  1142BX 

Office  of  Naval  Research, 

Code  1142BX 
800  N.  Quincy  Street 
Arlington,  VA  22217-5000 

OMR  CODE  1142C3 
Office  of  Naval  Research, 
Code  1142CS 
800  N.  Quincy  Street 
Arlington,  VA  22217-5000 
(6  Copies) 

OHR  CODE  1142PS 
Office  of  Naval  Research, 
Code  1142P3 
800  N.  Quincy  Street 
Arlington,  VA  22217-5000 

ONR  LONDON 
Psychologist 

Office  of  Naval  Research 
Branch  Office,  London 
Box  39 

FPO  New  York,  NY  09510 

ONR  MARINE  CORPS 
Special  Assistant  for  Marine 
Corps  Matters, 

ONR  code  00MC 
800  N.  Quincy  St. 

Arlington,  VA  22217-5000 

ORASANU  JUDITH 
Or .  Judith  Orasanu 
Basic  Research  Office 
Army  Research  Institute 
5001  Eisenhower  Avenue 
Alexandria,  VA  22333 

PAULSON  JAMES 
« 

Dr.  James  Paulson 
Department  of  Psychology 
Portland  State  University 
P.O.  Box  751 
Portland,  OR  97207 


PERXXNS  DAVID  N 
Or.  David  N.  Perkins 
Project  Zero 
Harvard  Graduate  School 
of  Education 
7  Appian  Nay 
Cambridge,  MA  02138 

PERRY  NANCY  N 

Dr.  Nancy  N.  Perry 

Naval  Education  and  Training 

Program  Support  Activity 

Code-047 

Building  2435  < 

Pensacola,  PL  32509-5000 

PXROLLX  PETER 
Dr.  Peter  Pirolli 
School  of  Education 
University  of  California 
Berkeley,  CA  94720 

PLOMP  TJEERD 
Dr.  Tjeerd  Plomp 
Twente  University  of  Technology 
Department  of  Education 
P.O.  Box  217 
7500  AE  ENSCHEDE 
THE  NETHERLANDS 

POLSON  MARTHA 
Dr.  Martha  Poison 
Department  of  Psychology 
University  of  Colorado 
Boulder,  CO  80309-0345 

PSOTKA  JOSEPH 
Dr.  Joseph  Psotka 
ATTN:  PERI-IC 
Army  Research  Institute 
5001  Eisenhower  Ave. 

Alexandria,  VA  22333-5600 
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ncnsi  mn  d 

Or.  Mark  0.  Reckaae 
ACT 

F.  O.  Boa  168 
love  City,  IA  52243 

REDER  STEVE 
Or.  Star*  Radar 
Northwest  Regional 

Educational  Laboratory 
400  Liadaay  Bldg. 

710  8.W.  Sacond  Ave. 

Portland,  OR  97204 

Rzir  mo 
Or.  rrad  Halt 
Pbysica  Department 
Onlvaraity  of  California 
Berkeley,  CA  94720 

RE5MZCX  LAUREN 
Or.  Lauran  Raanick 
Laarning  R  6  O  Cantor 
University  of  Pittaburgh 
3939  O'Hara  Straat 
Pittaburgh,  PA  15213 

RICHARDSON  J  JEFFREY 
Or.  J.  Jaffray  Richardson 
Cantor  for  Appliad  AX 
Collaga  of  Buainaaa 
Onivaraity  of  Colorado 
Bouldar,  CO  80309-0419 

RX83LAND  SONINA  L 
Or.  Edwina  L.  Riaaland 
Dapt.  of  Computer  and 
Information  Scianca 
Onivaraity  of  Maaaachuaatts 
Aaharst,  MA  01003 

ROBERTS  LINDA  G 
Or.  Linda  G.  Roberta 
Scianca,  Education,  and 
Transportation  program 
Offica  of  Technology  Aaseasment 
Congraas  of  tho  United  States 
Nashington,  DC  20510 

ROBIN  DONALD 
Dr .  Donald  Rubin 
Statistics  Department 
Scianca  Center,  Room  608 
1  Oxford  Street 
Harvard  University 
Cambridge,  MA  02138 

SAMEJXMA  FUMIKO 
Dr.  Fumiko  Samejima 
Department  of  Psychology 
University  of  Tennessee 
310B  Austin  Peay  Bldg. 
Knoxville,  TN  37916-0900 


3CHANX  ROGER 

Or.  Roger  Schank 

Tala  Onivaraity 

Computer  Science  Department 

P.O.  Box  2158 

New  Haven,  CT  06520 

8CHOENFELD  ALAN  H 
Or.  Alan  H.  Schoenfeld 
Onivaraity  of  California 
Department  of  Education 
Barkalay,  CA  94720 

SCHOFIELD  JANET  W 
Dr.  Janet  M.  Schofield 
816  LROC  Building 
Onivaraity  of  Pittsburgh 
3939  O' Kara  Straat 
Pittaburgh,  PA  15260 

SEGAL  JUDITH  W 

Or.  Judith  M.  Segal 

OERI 

555  New  Jersey  Ava . ,  NW 
Washington,  DC  20208 

SEIFERT  COLLEEN  M 
Or.  Colleen  M.  Seifert 
Institute  for  Cognitive  Science 
Mail  Coda  C-015 

University  of  California,  San  Diego 
La  Jolla,  CA  92093 

SHULMAM  LEE  S 
Dr.  Lea  S.  Shulman 
School  of  Education 
507  Caras 

Stanford  University 
Stanford,  CA  94305-3084 

SIEGLER  ROBERT  S 
Dr.  Robert  3.  Sieglar 
Camegie-Mellon  University 
Department  of  Psychology 
Schenley  Park 
Pittsburgh,  PA  15213 

SILVER  EDWARD 
Dr.  Edvard  Silver 
LRDC 

University  of  Pittsburgh 
3939  O'Hara  Street 
Pittsburgh,  PA  15260 

SIMON  HERBERT  A 
Dr.  Herbert  A.  Simon 
Department  of  Psychology 
Carnegie-Mellon  University 
Schenley  Park 
Pittsburgh,  PA  15213 

SLEEMAN  DEREK 
Dr.  Derek  Sleeman 
Computing  Science  Department 
King' s  College 

Old  Aberdeen  AB9  2UB 

Scotland 

UNITED  KINGDOM 
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SNOW  RICHARD 
Dr.  Richard  E.  Snow 
School  of  Education 
Stanford  University 
Stanford,  CA  9430S 

SOLOWAY  ELLIOT 

Dr.  Elliot  Soloway 

Tala  University 

Coaputtr  Scianca  Department 

P.0.  Boa  2158 

Haw  Haven,  CT  08520 

SORXHSEM  RICHARD  C 
Dr.  Richard  C.  Soranaan 
Navy  Personnel  RID  Cantar 
San  Diego,  CA  92152*6800 

3PECXMAN  PAUL 
Dr.  Paul  Speckman 
Onivaraity  of  Miaaouri 
Dapartaant  of  Statiatica 
Columbia,  HO  65201 

STEARNS  MARIAN 
Dr.  Marian  Staarna 
SRI  Intamational 
333  Ravenswood  Avu. 

Room  B-5124 

Manlo  Park,  CA  94025 

STERNBERG  ROBERT  J 
Dr.  Robart  J.  Sternberg 
Dapartaant  of  Paychology 
Tala  Onivaraity 
Box  11A,  Tala  Station 
Haw  Ha van,  CT  06520 

STEVENS  ALBERT 

Dr.  Albart  Stavana 

Bolt  Baranak  6  Nawman,  Inc. 

10  Moulton  St. 

Cambridge,  MA  02238 

STICHT  THOMAS 
Dr.  Thomas  Sticht 
Applied  Behavioral  and 
Cognitive  Sciences,  Inc. 

P.O.  Box  6640 

San  Diego,  CA  92106 

SUPPE3  PATRICK 
Dr .  Patrick  Suppes 
Stanford  University 
Institute  for  Mathematical 

Studies  in  the  Social  Sciences 
Stanford,  CA  94305-4115 

SWAMTNATHAN  hariharan 
Ur.  Ilaiiharan  Swaminathan 
Laboratory  of  Psychometric  and 
Evaluation  Research 
School  of  Education 
University  of  Massachusetts 
Amherst,  MA  01003 


3TMPS0N  BRAD 

Mr.  Brad  Sympson 

Navy  Personnel  R4D  Center 

Codt*62 

San  Diego,  CA  92152-6800 

TANGNET  JOHN 
Dr .  John  Tangney 
ATOSR/NL,  Bldg.  410 
Bolling  APB,  DC  20332-6448 

TATSOOKA  KIKUMI 
Dr.  Kikumi  Tatauoka 
CERL 

252  Engineering  Research 
Laboratory 

103  S .  Mathews  Avenue 
Urbana,  IL  61801 

TAYLOR  M  MARTIN 
Dr.  M.  Martin  Taylor 
DCIEM 
Box  2000 

Downs view,  Ontario 
CANADA  M3M  3B9 

THORNDIKE  PERRT  N 

Dr.  Perry  N.  Thoradyke 

PMC  Corporation 

Central  Engineering  Labs 

1205  Coleman  Avenue,  Box  580 

Santa  Clara,  CA  95052 

TONNE  DOUGLAS 
Dr.  Douglas  Towne 
Behavioral  Technology  Labs 
University  Of  Southern  California 
1845  S.  Elena  Ave. 

Redondo  Beach,  CA  90277 

TSUTAKAMA  ROBERT 
Dr.  Robert  Tsutakawa 
University  of  Missouri 
Department  of  Statistics 
222  Math.  Sciences  Bldg. 

Columbia,  MO  65211 

TNOKIG  PAUL  T 
Dr.  Paul  T.  Twohig 
Army  Research  Institute 
5001  Eisenhower  Avenue 
ATTN:  PERI-RL 

Alexandria,  VA  22333-560Q 

TIER  ZITA  E 
Dr.  Zita  E.  Tyer 
Department  of  Psychology 
George  Mason  University 
4400  University  Drive 
Fairfax,  VA  22030 

USMC  HQ 

Headquarters,  U.  S.  Marine  Corps 
.Code  MPI-20 
Washington,  DC  20380 


L 


VALE  DAVID 
Dr.  David  Vale 
kuMiMnt  Syateas  Corp. 

2233  University  Avenue 

Suita  440 

St.  Saul,  HN  55114 

VAH  LSHN  KURT 
Dr.  Kurt  Van  Lehn 
Department  o f  Psychology 
Carnegie-Mellon  Univaraity 
Scbenley  Sark 
Pittsburgh,  SA  15213 

nu»  mimo-mei 
Dr.  Ming-Mai  Wang 
Lindquist  Cantar 
for  Measurement 
Univaraity  of  Iowa 
Iowa  City,  ZA  52242 

WARREN  BETS 

Dr.  Bath  warran 

BBH  Laboratories,  Inc. 

10  Moulton  Straat 
Cambridge,  MA  02238 

WHITE  BARBARA 
Dr.  Barbara  White 
BBH  laboratoriaa 
10  Moulton  Straat 
Cambridge,  MA  02238 

WZM6  HILDA 
Dr.  Hilda  Wing 
KRC  MH-178 

2101  Conatitution  Ava. 

Waahington,  DC  204 IS 

WISHER  ROBERT  A 

Dr.  Robert  A.  wiahar 

O.S.  Army  Znatituta  for  tha 

Bahavioral  and  Social  Sciancaa 
5001  Eiaanhowur  Avanua 
Alexandria,  VA  22333-5800 

wtSKorr  martih  f 
Dr.  Martin  F.  Wiakoff 
Oafanaa  Manpower  Data  Cantar 
550  Camino  El  Estero 
Suita  200 

Monterey,  CA  93943-3231 

WZTTROCK  MERLIN  C 
Dr.  Marlin  C.  Wittrock 
Graduate  School  of  Education 
UCLA 

Loa  Angeles,  CA  90024 

WOLFE  JOHN  H 

Mr.  John  H.  Wolfe 

Navy  Personnel  RSD  Center 

San  Diego,  CA  92152-8800 


WONG  GEORGE 
Dr.  Gaorga  Wong 
Bioatatiatica  Laboratory 
Manorial  Sloan-Kattaring 
Cancer  Canter 
1275  York  Avanua 
Haw  York,  NY  10021 
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